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Abstract 

In this paper we study the nonlinear Schrodinger-Maxwell equa- 
tions 

-Au + V{x)u + (j)u=\u\P-'^u inM^, 
-A(/) = u2 inM^ 

If is a positive constant, we prove the existence of a ground state 
solution {u, (j)) for 2 < p < 5. The non-constant potential case is 
treated under suitable geometrical assumptions on V, for 3 < p < 5. 
Existence and non-existence results are proved also when the nonlin- 
earity exhibits a critical growth. 
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1 Introduction 



In this paper we consider the problem 



Au + V {x)u + (j)u = f (u) inM^, 
= in 



(SM) 



where y : M"^ ^ M and / G C^(]R^, M). Such a system represents the non- 
linear Schrodinger-Maxwell equations in the electrostatic case. In [3], the 
potential V has been supposed constant, and the linear version of the prob- 
lem (i.e. / = 0) has been studied as an eigenvalue problem for a bounded 
domain. The linear Schrodinger-Maxwell equations have been treated also 
in [9, 11], where the potential V has been supposed radial. 

The nonlinear case has been considered in [1, 10, 13, 15, 20], where ex- 
istence and multiplicity results have been stated when V is a positive con- 
stant. By means of the Pohozaev's fibering method, a multiplicity result 
has been proved in [21] also in the non-homogeneous case, that is when a 
non-homogeneous term g(x) E L^(M'^) is added on the right hand side of 
the first equation of (SM) (see also [7]). On the other hand, nonexistence 
results for (SAi) can be found in [14, 20]. For a related problem see [18]. 

In this paper we will look for ground state solutions to the problem 
(SAi), namely for couples (n, (p) which solve (SAi) and minimize the ac- 
tion functional associated to{SA4) among all possible solutions. The prob- 
lem of finding such a type of solutions is a very classical problem: it has 
been introduced by Coleman, Glazer and Martin in [12], and reconsidered 
by Berestycki and Lions in [5] for a class of nonlinear equations including 
the Schrodinger's one. Later on the existence and the profile of ground 
state solutions have been studied for a plethora of problems by many au- 
thors; of course we can not mention all these results. 

In the first part of the paper, we are interested in considering pure 
power type nonlinearities so that the problem we will deal with becomes 




ip-i 



u inM^ 
inM^ 



(1) 
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where 2 < p < 5. The solutions (n, 0) G H\M.^) x V^^^{M.^) of (1) are the 
critical points of the action functional S : iJ^(M^) x P^'^(]R^) —>■ M, defined 
as 

£iu,<P):=l[ \Vu\^ + V{x)u'-- I |V0r + ^/ ct^u'-^j \ur\ 

We are interested in finding a ground state solution of (1), that is a solu- 
tion (mo, 0o) of (1) with the property of having the least action among all 
possible solutions of (1), namely £{uo, 0o) ^ ^iu, 0), for any solution (m, 0) 
of (1). 

The action functional £ exhibits a strong indefiniteness, namely it is 
unbounded both from below and from above on infinite dimensional sub- 
spaces. This indefiniteness can be removed using the reduction method 
described in [4], by which we are led to study a one variable functional 
that does not present such a strongly indefinite nature. 

The main difficulty related with the problem of finding the critical 
points of the new functional, consists in the lack of compactness of the 
Sobolev spaces embeddings in the unbounded domain M"^. Usually, at least 
when V is radially symmetric, such a difficulty is overcome by restricting 
the functional to the natural constraint of the radial functions where com- 
pact embeddings hold. In particular, in [13] a radial solution having min- 
imal energy among all the radial solutions has been found. However we 
are not able to say if that solution actually is a ground state for our equa- 
tion. This is the reason why we will use an alternative method, based on 
a concentration-compactness argument on suitable measures, to recover 
compactness. 

We analyze two different situations. First we assume that V is a posi- 
tive constant and, following an idea of Ruiz [20], we look for a minimizer 
of the reduced functional restricted to a suitable manifold Ai. Such a man- 
ifold has two interesting features: it is a natural constraint for the reduced 
functional and it contains, in a sense that we will explain later (see Re- 
mark 2.2), every solution of the problem (1). The main result we get is the 
following 

Theorem 1.1. IfV is a positive constant, then the problem (1) has a ground state 
solution for any p g]2, 5[. 

In fact, it is standard to see that such a ground state solutions does not 
change sign, so we can assume it positive. 

Then we study (1) assuming the following hypotheses on V : 

(VI) V G C(M3,M); 
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(V2) < Ci ^ V{x) ^ C2, for all x G 

(V3) Voo ■= liminf|y|^oo ^(y) ^ Vix), for all x E M.^, and the inequality is 
strict for some a; G M^. 

These kind of hypotheses on the potential were introduced by Rabinowitz 
[19] to study the nonlinear Schrodinger equation 



Because of technical difficulties we are not allowed to use the same de- 
vice as in the constant potential case. We study the reduced functional 
restricted to the Nehari manifold and we are able to prove the existence 
result only for 3 < p < 5: 

Theorem 1.2. IfV satisfies (Vl-3) then the problem (!) has a ground state solu- 
tion for any p g]3, 5[. 

Theorems 1.1 and 1.2 will be proved in Section 2. 

In the second part of the paper we consider the critical case, namely 
the case when the nonltnearity presents at infinity the same behavior of 
the power where 2* = 6 is the critical exponent for the Sobolev em- 
beddings in dimension 3. Here a further obstacle to compactness arises, 
in fact, it is well known that the embedding of the space H^(^l) into the 
Lebesgue space L^* (fi) is not compact, even if f2 is a bounded set in M^. 

The problem becomes 



By [14], we have the following 

Theorem 1.3 (D'Aprile & Mugnai [14]). Suppose that V is a positive constant. 
Let {u, (p) G H^{R^) X pi'2(M3) be a solution of the problem (2), then u = (p = 0. 

We extend this nonexistence result to the case of a non-constant poten- 
tial V. We prove the following nonexistence theorem, based on a Pohozaev- 
type identity. 



Am + V{x)u = f{u) 




(2) 



Theorem 1.4. Suppose that V satisfies (V2) and 



(V4) V G Ci(MlM); 

(V5) ^ {VV{x) I x) ^ Csjorall x G Ml 
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Let (u, 0) G H\R^) X P^'2(^]R3) i^e a solution of the problem (2), then u = (j) = 0. 

Then, in the same spirit of [6] (see also [8] for the Klein-Gordon-Maxwell 
equation), we add a lower order perturbation to the first equation of (2), 
namely we look for solutions to the system 



where q g]3,5[. The solutions (n, G H\R^) x V^^^{R^) of (3) are the 
critical points of the action functional S* : H'^{R^) x I?1'2(]R3) _^ defined 



The effect of the additive perturbation is to lower the energy This causes 
that the ground state level of the functional falls into an interval where 
compactness holds. As a consequence we get the following two results, 
respectively for the constant and the non-constant potential case: 

Theorem 1.5. Let V be a positive constant. Then the problem (3) has a ground 
state solution. 

Theorem 1.6. Let V satisfy (Vl-3). Then the problem (3) has a ground state 
solution. 

We will prove these three last theorems in Section 3. 



• For any 1 ^ s < +oo, is the usual Lebesgue space endowed 

with the norm 




(3) 



as 




NOTATION 




• if^(M^) is the usual Sobolev space endowed with the norm 



u 



2 . 




2. 
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• P^'^(]R^) is completion of C^(M^) with respect to the norm 




• for any r > 0, x G and A C 

Br{x) := {y G I |y - x| ^ r}, 
Br := {yeW'l \y\ ^ r}, 
A' := \ A; 

• C, C, Ci are positive constants which can change from line to line; 

• o„(l) is a quantity which goes to zero as +00. 

2 The subcritical case 
2.1 Some preliminary results 

We first recall some well-known facts (see, for instance [3, 9, 10, 11, 13, 20]). 
For every u E L^^/^(]R'^), there exists a unique 0„ G ©^'^(M"^) solution of 

-A0 = u^ in Ml 

It can be proved that (n, (p) G H\R^) x V^''^(R^) is a solution of (1) if and 
only if u G if^(M^) is a critical point of the functional /: iJ^(M^) M 
defined as 

I{u) = \! iVnp + V{x)u' + - f <\>y [ \ur\ (4) 

and (j) = (j)u- 

The functions 0„ possess the following properties (see [13] and [20]) 

Lemma 2.1. For any u G i/^(M^), we haye; 

2) ||0«||di.2(ir3) ^ C||m||^, where C does not depend from u. As a consequence 
there exists C" > such that 




ii) (pu^O; 
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Hi) for any t > 0; (pm = t^4>u', 

iv) for any 6 > 0; <f)ug{x) = O'^cpuifix), where ue{x) = 6'^u{6x); 

v) for any c measurable, 

<Puu'= [ [ "^^P^dxdy. 
n Jn Jr3 \x - y\ 

2.2 The constant potential case 

In this section we will assume that V is a positive constant. Without lost 
of generality, we suppose V = 1. It can be proved (see [14, 20]) that if 
(n, (p) e iJi(]R^) X pi'2(M3) is a solution of (1), then it satisfies the following 
Pohozaev type identity 

l-\Vu\^ + lu^ + l<j>u^-^\ur' = 0. (5) 
2 2 4 p+1 

As in [20], we introduce the following manifold 

:= |MGiJ'(M^)\{0} G(m) = o}, 



where 

G{u):= I |vn|2 + in2 + ^0„u2-^^^|n 
Jm.3 2 2 4 p+1 



p+1 



Remark 2.2. Observe that ifue H^{M.^) is a nontrivial critical point of I, then 
u G Ai, since G{u) = can be obtained by a linear combination of {I'{u), u) = 
and (5), with = As a consequence if{u,(f)) G H^{M.^) x V^''^{R^) is a 
solution of (1), then u G M. 

The next lemma describes some properties of the manifold Ad: 

Lemma 2.3. 1. For any u G if^(M^), n 7^ 0, there exists a unique number 
6 > such that uq e M. Moreover 

liun) = max /(wfl): 

2. there exists a positive constant G, such that for all u G M, ||m||p+i ^ G; 

3. M is a natural constraint of I, namely every critical point of I\m ^ 
critical point for I. 
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Proof We refer to [20]. In particular, as regards point 3, we have to point 
out that Ruiz [20] has just proved that the minimum of is in fact a crit- 
ical point of I: the same arguments can be adapted to prove that M is a 
natural constraint of /. □ 

By 3 of Lemma 2.3 we are allowed to look for critical points of / re- 
stricted to M. 

Moreover, by 1 of Lemma 2.3, the map 6 : H^{R^) \ {0} M+ such that for 

any M e H\R^), u ^ : 

I {ue{u)) = max/(ne) 

is well defined. 
Set 

Ci = inf max I(q(6)): 
5Greg[o,i] ^""^ 

C2 = inf max /(mq): 
C3 = inf/(M); 

where 



r = e C([0, 1], H\R')) I g{0) = 0, I{g{l)) <: 0, g{l) ^ O} . 
Lemma 2.4. The following equalities hold 



(6) 



c :— C\ — C2 — C3. 



Proof Taking into account 1 of Lemma 2.3 and the fact that for small 
we have (see [20, Theorem 3.2, Stepl]) 



2p- 1 



\u 



ip+i 



M3 p- 



the conclusion follows using the same arguments of [19, Proposition 3.11]. 

□ 



Remark 2.5. By -point 3 of Lemma 2.3 and Remark 2.2, we argue that ifueM 
is such that I{u) = c, then {u, 0^) is a ground state solution of (1). 
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2.2.1 Proof of Theorem 1.1 

Let (m„)„ C M such that 



lim/(u„) = c. (7) 



n 



We define the functional J: H^{W) ^ M as: 

J^,2p-l 2p-l 2(2p-l) 

Observe that for any u E Ai,hy ii oi Lemma 2.1 we have /(n) = J(n) ^ 0. 
By (7), we deduce that (u„)„ is bounded in if^(M^), so there exists u e 
H^(R^) such that, up to a subsequence, 

Un^u weakly in ^ (M^) , (8) 
(5), with 5 c M^ bounded, and 1 ^ s < 6. 

To prove Theorem 1.1, we need some compactness on the sequence 

To this end, we use a concentration-compactness argument on the positive 

measures so defined: for every m„ g if^(M^), 

By (7) we have 

and then, by P.L. Lions [16], there are three possibilities: 
vanishing : for all r > 



lim sup / = 0; 



dichotomy : there exist a constant c G (0, c), two sequences {^n)n and (r„), 
with Tn ^ +00 and two nonnegative measures and z/,^ such that 



SUpp(z/^) C Br^i^n), SUpp(z/2) C M^' \ B2r^{Q; 

compactness : there exists a sequence (^n)n in with the following prop- 
erty: for any 5 > 0, there exists r = r{6) > such that 

dun ^ c — 6. 

Br (in) 
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Arguing as in [23], we prove the following 

Lemma 2.6. Compactness holds for the sequence of measures {i'n)nr defined in 
(9). 

Proof Vanishing does not occur 

Suppose by contradiction, that for all r > 

lim sup / dvn = 0. 
In particular, we deduce that there exists f > such that 



lim sup / M„ = 0. 

By [17, Lemma LI], we have that n„ ^ in L''(M^), for 2 < s < 6. As a 
consequence, since c M and by Lemma 2.1, we get 

J^3 Z Z 4 p + I 



which contradicts (7). 



Dichotomy does not occur 

Suppose by contradiction that there exist a constant c G (0, c), two se- 
quences (^n)n and (r„)„, with r„ ^ +oo and two nonnegative measures 
and i/^ such that 



SUpp(z/;^) C B,„(en), SUpp(l/2) C \ 52.„(en). 

Let pn e CH^') be such that p„ = 1 in 5,„(e«), p„ = in \ B2rAU' 
^ ^ 1 and \Vpn\ ^ 2/r„. 
We set 

V„ := PnUn, Wn := (1 - Pn)Un- 

It is easy to see that 

liminf J(f„) ^ c, 
liminf J{wn) ^ c — c. 
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Moreover, denoting fi„ := fi2r„(^n) \ 3,.^^^), we have 

UniVLn) — > 0, as n — i> oo, 

namely 

/ |Vn.„p + n^^O, as n ^ oo, 

I 0n„Mn 0) as n ^ oo. (10) 
By simple computations, we infer also 

iVfnP + v'^ ^0, as n — > oo, 



£7 



iVuinP + — ^ 0, as — oo. 



Hence, we deduce that 



|Vu„|2 + u2= / \Vvr,\^ + i?^ + / |Vii;„p + u;^ + o„(l), (11) 

\Unr'= f \Vnr'+ f knr+' + On(l). (12) 



Moreover, by point v of Lemma 2.1 and (10), we have 



BrjB-^^^ \X-y\ 

> I + I Kr.wl + 0^{1). (13) 

Hence, by (11) and (13), we get 

J{Un) ^ J{Vn) + J{Wn) + 0„(1). 

Then 

c = lim J{un) ^ liminf J(w„) + liminf J{wn) ^ c + {c — c) = c, 

n n n 

hence 

lim J{vn) = 5, (14) 

n 

lim J{wn) = c — c. 
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We recall the definition of the functional G: H^{R^) 

Jigs 2 2 4 p+1 

and that if u e M, then G{u) = 0. By (11), (12) and (13), we have 

= G{un) ^ + G{w^) + o„(l). (15) 

By Lemma 2.3, for any n ^ 1, there exists ft„ > such that {vn)e„ E M, and 
then 

/ k|V..P + ^n^ + k0.„^'^= / ^e->.r- (16) 
iR3 2 2 4 P + 1 

We have to distinguish three cases. 

Case 1: up to a subsequence, G(f„) ^ 0. 
By (16) we have 

/ |(e-^ - oDl^v^l' + \{o^r' - + lier' - el)<f>.A ^ o, 

which implies that 6'„ ^ 1. Therefore, for all n ^ 1 

which is a contradiction. 

Case 2: up to a subsequence, G{wn) ^ 0. 
We can argue as in the previous case. 

Case 3: up to a subsequence, G(w„) > and G{wn) > 0. 

By (15), we infer that G{vn) = o„(l) and G{wn) = o„(l). If 6'„ ^ 1 + o„(l), 

we can repeat the arguments of Case 1. Suppose that 

lim6'„ = 00 > 1. 

n 

We have 

J^z 2 2 4 p+1 
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and so w„ ^ in H^{M.^), but we get a contradiction with (14). 

Hence we conclude that dichotomy can not occur. □ 

Now we are able to yield the following 

Proof of Theorem 1.1 Let be a sequence in M such that (7) holds. 
We define the measures (z/„),i as in (9); by Lemma 2.6 there exists a se- 
quence {^n)n in with the following property: for any 5 > 0, there exists 
r = r{6) > such that 

We define the new sequence of functions Vn ■= Un{- — ^n) G It is 

easy to see that = — ^n)> and hence w„ G M. Moreover, by (17), 
we have that for any 6 > 0, there exists r = r{6) > such that 

||f„||/^i(Bc) < 5 uniformly for n ^ 1. (18) 

Since, by (8), (f„)„ is bounded in if^(M^), certainly there exist a subse- 
quence (likewise labelled) and v E H^(K^) such that 

Vr,^v weakly in iJ^(M^), (19) 
Vr,^v in (5), with B C M^ bounded, and 1 ^ s < 6. (20) 

By (18), (19) and (20), we have that, taken s G [2, 6[, for any 5 > there 
exists r > such that, for any n ^ 1 large enough 

\\Vn - ^^||l=(R3) ^ \\Vn - + \\Vn - v\\l=(B!^) 

<S + C (||w„||i^i(Bc) + \\v\\hhb^^)) ^ (1 + 2C)5, 

where C > is the constant of the embedding H^{B';) ^ L''{B^). We 
deduce that 

Vn^vin L'(M^), for any s G [2, 6[. (21) 
Since </> is continuous from L^^/^(M^) to from (21) we deduce that 

(/>7,„ — (t>v inV^''^{R^), as n — > cxD, 

2 , / 1 T,2 



(pv^'^n (t^vV , as n ^ OO. (22) 

Since (f„)n is in M, by 2 of Lemma 2.3 (||f„||p+i)„ is bounded below by a 
positive constant. As a consequence, (21) implies that w 7^ 0. Proceeding 
as in [20, Theorem 3.2, Step 4], by (21) and (22) we can show that Vn v 
in ff^(M^) so that v E M. and I{v) = c. By Remark 2.5, we have that (w, (f)^) 
is a ground state solution of (1). □ 
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2.3 The non-constant potential case 

In this section we suppose that the potential V satisfies (Vl-3) and that 

pe]3,5[. 

In order to get our result, we will use a very standard device: we will 
look for a minimizer of the functional (4) restricted to the Nehari manifold 



A/- = |m G H\W^) \ {0} I G{u) = o} , 

where 

G{u):=[ |Vm|^ + m^ + 0„m^- 

The following lemma describes some properties of the Nehari manifold J\f: 

Lemma 2.7. 1. For any u there exists a unique number t > such that 
tu E M and 

litu) = max/ftn): 

2. there exists a positive constant C, such that for all u E M, |hi||p+i ^ C; 

3. M is a manifold. 

Proof Points 1 and 2 can be proved using standard arguments (see, for 
example, [19]). 

3. Observe that for any u E H^(R^) we have 

G{u)=AI{u)- j {\Vu\^ + V{xy) [ \u\^+\ 
and then, by point 2, for any u E M we have 

{G'iu), u) = -2 [ (I Vnp + Vixy) - {p - 3) [ ^ -C < 0. 

□ 



The Nehari manifold J\f is a natural constrained for the functional /, 
therefore we are allowed to look for critical points of / restricted to J\f. 
In view of this, we assume the following definition 

cv '■= inf I{u), 

so that our goal is to find u E M such that I{u) = cy, by which we would 
deduce that (m, 0^) is a ground state solution of (1). 
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First we recall some preliminary lemmas which can be obtained by us- 
ing the same arguments as in [19] (see also [2]). 

As a consequence of the Lemma 2.7, we are allowed to define the map 

t : i/i(R3) \ {0} M+ such that for any u G //^(M^), m ^ : 

/ (t(u)u) = max I (tu). 

Lemma 2.8. The following equalities hold 

Cy = inf max liqit)) = inf maxl(tu), 
9ertg[o,i] u^o m 

where V is the same set defined in (6). 

Lemma 2.9. Let Un G H^{M?), n ^ 1, such that ||n,„|| ^ C > and 

with 5„ — >• 0"*". Then, there exist a sequence {yn)n C and two positive numbers 
R, > such that 



liminf / \un\ dx > fi. 

'BR{y„) 



Lemma 2.10. Let {un)n C i/-'^(M^) such that \\un\\ = 1 and 

I(t(Un)Un) = maxI(tUn) — > Cy, flS 72 — > OO. 

Then the sequence (t{un))n C M+ possesses a bounded subsequence in R. 
Proof We have 

/ \vur.\'+v{x)ui = tiU-' [ Kr^-/ <PuyX 

The conclusion follows from % of Lemma 2.1 and Lemma 2.9. □ 



Lemma 2.11. Suppose that V, Vn satisfy (yi-2) , for all n^l. 
IfVn^V in L°°(M^) then cy„ cy. 

Now define 

Coo := Cy^- 

As in [19], we have 
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Lemma 2.12. IfV satisfies (Vl-3), we get cy < c^o- 

Proof By Theorem 1.1, there exists {w, 0^) G H^{M?) x V^''^{M?) a ground 
state solution of the problem 

{ -Au + VooU + (t)u = \u\^-^u inM^ 
\ -A0 = inM^. 

Let t{w) > be such that t{w)w G N. By (V3), we have 

Coo = looiw) ^ Ioo{t{w)w) 

= I{t{w)w) + I (Ko - V{x)) \t{w)w\^ > Cv, 
and then we conclude. □ 



2.3.1 Proof of Theorem 1.2 

Let {un)n be a sequence in Af such that 

limJ(M„) = Cv- 

n 

Observe that for any u E M we have 



(23) 



I(^u)=(l--^) I \Vu\^ + V{x)u'+(--^\ [ 



hence, by (23), we deduce that is bounded in H\M.^). Let u G H\m:-^) 
be such that, up to a subsequence. 



u weakly in H 



1 1^^>^^ 



(24) 



Un u in (5), with B C M^ bounded, and 1 ^ s < 6. (25) 
We define the measures 



1 



P+ 1 



I Vwr 



V^(x)-u: 



1 



1 



P+ 1 



Proceeding as in Lemma 2.6, we infer that compactness holds for {fin)n, 
namely there exists a sequence {^n)n in with the following property: for 
any 6 > 0, there exists r = r{5) > such that 



P+ 1 



p+ 1 



i.„«^<5. (26) 
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Claim: is bounded in M^. 

Suppose by contradiction that, up to a subsequence, ^ cxd, as n ^ cxd. 
Fix V < Voo and let / be the functional defined as / replacing V by V. For 
any n ^ 1, let Zn = Un{- — ^n) and t „ > such that the functions inZn are in 
the Nehari manifold of /. 

Let 5 > and consider r > such that (26) holds. For n sufficiently large, 
we have 

Vix + ^n)-V^O, for all x e Br. 

Hence we have 

cv + o„(l) = /(uj ^ J(t„n„) = i{inUn) + % I (V{x) - V) ul 

^c^ + l/ (v{x + U-v)z'r, + ^j [ (V{x + U-V)zl 

J Br ^ B^ 

><^v-%l V{x + i^)-V zl 
Since by (26) 

/ V{x + ^n)-V zl^ C6, for any n ^ 1, 

and {in)n is bounded (the proof is the same as in Lemma 2.10), we get 
that Cv ^ Cy — C6. By the arbitrariness in the choice of 5 > 0, we have 
Cv ^ Cy. Using Lemma 2.11 we conclude that cy ^ Coo, which contradicts 
Lemma 2.12. 

So {^n)n is bounded in and then, by (26), for any 5 > there exists 
r > such that 



u 



n\\H^{B^) < ^> uniformly forra ^ 1. (27) 



By (24), (25) and (27), we have that, taken s E [2, 6[, for any 5 > there 
exists r > such that, for any n ^ 1 large enough 

ll^n - m||l''(M3) ^ \\Un - u\\L={Br) + \\Un " u\\L={Bf) 

+ C (IMhhb^^) + MIhhb^^)) ^ (1 + 2C)6, 

where C > is the constant of the embedding H^{B!f) L^iyB^). We 
deduce that 

Un-^uirv L"(M3), for any s E [2, 6[. (28) 
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Since is continuous from L^^/^(]R^) to ■D^'^(M^), from (28) we deduce that 

0„„ ^ 0s in as n ^ oo, 

/ 0«„^*n / as n ^ oo, (29) 

and for any ^ G ^^(M^) 




By (23), we can suppose (see [24]) that (m„)„ is a Palais-Smale sequence for 
I\^f and, as a consequence, that it is easy to see that is a Palais-Smale 
sequence for /. By (24), (28) and (30), we conclude that r{u) = 0. 
Since is in Af, by 3 of Lemma 2.7 (||n„||p)„ is bounded below by a 
positive constant. As a consequence, (28) implies that u ^ and sou e Af. 
Finally, by (24), (28) and (29), 

Cy ^ I{u) ^ liminf = cy, 

so we can conclude that (u, is a ground state solution of (1). 



3 The critical case 

This section is devoted to the study of the critical case and in particular we 
will give the proofs of Theorem 1.4, Theorem 1.5 and Theorem 1.6. 



3.1 The nonexistence result 

Proof of Theorem 1.4 Arguing as in [5, 14], we can prove that if (u, 0) G 

H\R^) X pi'2(R3) is a solution of the problem (2), then {u, (p) satisfies the 
following Pohozaev identity: 

/ |Vm|2 + 3 / V{x)u^+ I {W{x)\x)u^ + ^ [ (l)u^ = I u^. (31) 
Jm? Jr^ Jr^ 2 J^3 J]R3 

Multiplying the first equation of (2) by u and integrating, we have 

/ |Vnp+ / V{x)u'^+ [ (Pu^= [ u^- (32) 

ilR3 JR3 Jr3. J^3 

on the other hand, multiplying the second equation of (2) by and inte- 
grating, we have 

[ |V0r = / <Pu'. (33) 
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By the combination of (31), (32) and (33), we infer that 

2/ V{x)u^+ [ {\/V{x)\x)u^ + ^ [ |V0|2 = O, 
which, together with (V2) and (V4), implies that n = = 0. □ 

Remark 3.1. In fact, the same nonexistence result would hold even if we supposed 
the weaker hypothesis 

< C4 ^ 2V{x) + (yV{x) I x) ^ C5, for all x e M^ 

in the place o/(V4). 

3.2 The existence results 

As in subsection 2.1, for every u G L^^/^(M^) we denote by G ^'-'^'^(IR^) 
the unique solution of 

-A0 = M^ in Ml 

It can be proved that (m, 0) e H'^{R^) x ^'^'^(M^) is a solution of (3) if and 
only if u E H\R^) is a critical point of the functional /* : H^{R^) M 
defined as 

r{u):=\l \vu\' + v{x)u' + ^- [ <py-^f \ur'-\l u\ 

and = (pu- 

The Nehari manifold of the functional /*, defined as 

N* := |m e i/^(M3)\{0}| j |Vm|' + + cp^u^ - \u\''+^ - = o| , 

satisfies the equivalent of Lemma 2.7 and so it is a natural constraint for /* 
and we are looking for critical points of /* restricted to A/"*. 
Set 

ct = inf max /*(gf(t)): 
Cn = inf max J*(tM): 
cl= inf r(«); 

where 

r = G C([0, 1], i/^lM^^)) I (7(0) = 0, r{g{l)) ^ 0, g{l) + O} . 
It is standard to prove that 
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Lemma 3.2. The following relations hold 



Co. 



We denote by S the best constant for the Sobolev embedding r'^'^(M^) 
namely 



S= inf 



2 



uGX'l.2\{0} llwllg 

3.2.1 The constant potential case 

In this section we suppose that V is a positive constant. For simplicity we 
assume V = 1 and we denote c* = Cy. 

Lemma 3.3. The following inequality holds 

Proof Consider the one parameter Talenti's functions G 'D^''^(R^) de- 
fined by 

1 

:= C, 



[e + |x| 

where > is a normalizing constant (see [22]). Let iphe a smooth cut off 
function, namely cp G C^(]R^) and there exists R > such that ^\br = 1/ 
^ ^ 1 and supp if C B2R. Set := u^^p and = Ws/\\we\\6- Using the 
estimates obtained in [6] we get 

\\Wve\\l = S + 0{e'^), (34) 
and, for any s G [2, 6[, 



0(£t), ifsG[2,3[, 
\v,\\l={ 0(£t|log(£)|), ifs = 3, (35) 
0(6^), ifsG]3,6[. 

For every £ > let > such that t^Vg G A/"*. Obviously (te)e>o is bounded 
below by a positive constant; otherwise there should exist a sequence 
such that lim„ = and then, by (34), Lemma 2.1 and (35), 

0<c* ^limr{t,^v,J = 0. 

n 

Claim: For any e > small enough ^ (Jj^g | Vt;^^ + w^)^^^ • 
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Let %{t) := r{tve) and set := {J^, \Vve\'^ + v^f^^ . By (34) and (35), 
('"£)e>o is bounded below by a positive constant. Since tsi'e E Af*, certainly 
'j'^ite) = 0. On the other hand, by i of Lemma 2.1 and (35), for any e small 
enough, 

ell 12 - i^-W^eWq+l 



^ trt - + C'tHve\\\2 -tnv. 11"+' 



_ ^5 ^ ^3 (c'Oie) - t''"=^0(£^)) 



where 0{e) and 0{e'^) are nonnegative functions. We deduce that, for 
any e > small enough, 7^(t) < in jr^, +oo[: the claim follows as a con- 
sequence. 



Now, since the function 



1 2 4 1 



teR+^ -rr: - -t' 



2" ■ " 6' 

is increasing in the interval [0, r^f, by (34) and i of Lemma 2.1 we have that 



6 



\(f |V^;.^ + ^;nVc'|iK||l2-^| 
3 \Jm3 J 4 5 g + 1 



4 (^-^(^''-^ *^4ii"'ii*-^iwK- 

Using the inequality (a + 6)^ ^ a*^ + 5{a + bY^^b which holds for any 5^1 
and a, 6 ^ 0, by (35) and the previous chain of inequalities we get 

r{t,v,) ^ + 0(£^) + C,{e)0{e) - C2(£)0(£V), (36) 

where Ci{e) and C2(e) are in an interval [a, (3] with a > 0. Since g > 3, the 
conclusion follows from (36), for e > small enough. □ 

Proof of Theorem 1.5 Let C Af* such that 

\imr{un)=c*. (37) 



n 
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We easily deduce that (n„)„ is bounded in if^(M^), so there exists u E 
if^(M^) such that, up to a subsequence, 

Un^u weakly in iJ^(M^), (38) 
(5), with B C M^ bounded, and 1 ^ s < 6. 

As in the first part of the paper, we use a concentration-compactness argu- 
ment on the sequence of positive measures 



2 q + lJJn V4 q+1 



1 1 



q+1 6 



We define the functional J* : H^{W) ^ M as: 



2 q+lj h^' V4 q + l 



Vanishing does not occur 

Suppose by contradiction, that for all r > 



lim sup / (i/i* = 0. 

" J Brio 



By [17] we deduce that m„ in L'{R^) for any s e]2, 6[ 
By i of Lemma 2.1, since (m„)„ C A/"*, it follows that 



lim 

n 



WUr 



By the boundedness of (m„)„ in H^(K^), we infer that there exists / > 
such that, up to subsequence. 



/ := lim / |Vn„P + ui = lim / u 



We have 



c* = limTK) = -l--l = -l 
^ ^ 2 6 3 



(39) 
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and 



S ^ U1^^jI±< ^ ,1 (40) 



3 



(/m3 '^n) 

By (39) and (40) we get c* = |/ ^ |55, contradicting 2 of Lemma 3.3. 
Dichotomy does not occur 

The proof uses similar argument as those in the proof of Theorem 1.1. 

So the measures /i* concentrate and, in particular, we have that there exists 
a sequence (^n)n in such that for any 6 > there exists r = r{6) > 
such that 

^ 1 * ' \Vun\^ + ui<6. (41) 



9 + V ^B-(en) 

From now on, we only give a sketch of the remaining part of the proof, 
since it is similar to that of the subcritical case. We define w„ := — 
It is easy to see that (f„)„ C Af*. From (41) we have that for any 6 > there 
exists r > such that 



||^n||_H'i(B^) < 5, uniformly for 77, ^ 1. 

Hence we deduce 



Vn^vin L'{R^), for any s e [2, 6[; (42) 

[ 0.„^n- / 0.^'- (43) 
Moreover, for any ip e C^f (M^), 



and, by (42), 




By (37), we can suppose (see [24]) that (f „)„ is a Palais-Smale sequence for 
and, consequently, it is a Palais-Smale sequence for /*. By standard 
arguments, we infer that v G TV*. 
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Finally, since (wn)n and v are in Af*, we have that 

r{v) = -[ \\/v\^+v'' + — [ ^,v^+(--^] [ \v\'i+\ 

3iR3 12 V V6 g + W 

so, by (37), (38), (42) and (43), 

c* ^ ^ liminf = c*. 

We conclude that (w, 0^,) is a ground state solution of (3). □ 

3.2.2 The non-constant potential case 



In this section we suppose that V satisfies hypotheses (Vl-3). 

We define the functional : if^(]R^) R and the Nehari manifold 
in the following way 




Lemma 3.4. The following inequality holds 



Proof By Theorem 1.5, there exists a ground state solution for (3) when- 
ever V = Voo; so, arguing as in Lemma 2.12, we can show that Cy < c^. 
Therefore, the inequality follows by Lemma 3.3. □ 

Following [19], by Lemmas 3.3 and 3.4 and using a non-vanishing type 
argument as in the proof of Theorem 1.2, we can show that the correspond- 
ing versions of Lemmas 2.9, 2.10 and 2.11 hold for the functional /*. 
Proof of Theorem 1.6 Let (u„)ri C M* such that 

limJ*(M„) = Cy. 
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We easily deduce that is bounded in if^(M^), so there exists u E 

H^{M.^) such that, up to a subsequence, 

Un^u weakly in H'^ (M^) . 

Let us define the positive measure 

Arguing as in the proof of Theorem 1.5, we can prove that the measures /i* 
concentrate and, in particular, we have that there exists a sequence {^n)n 
in such that for any 5 > there exists r = r{5) > such that 

fi-^) / |Vn„p + y(xK<5. (44) 

With the arguments similar to those of the subcritical case, we show that 
the sequence (C„)n is bounded in and then by (44) we have that for any 
6 > there exists r > such that 

W^nWrniB^) < uniformly for 77, ^ 1. 

Hence we deduce 

Un-^uin L'(M^), for any s e [2, 6[. 
Then, arguing as in the proof of Theorem 1.5, we get the conclusion. □ 
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